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The  Reliability  of  Mortality  Count  and  Suicide  Count  la  the 
United  States  Army 


William  £  Datel,  Ph.D.* 

“Our  Parocial  Registers  are  in  many  instances  now  kept  by  Par¬ 
ish-Clerks,  and  as  these  Record-keepers  derive  no  profit  from  the 
emp'oyment,  except  a  casual  shilling  now  and  then  for  a  search,  it 
may  be  imagined  what  sort  of  Record  is  kept,  where  ignorance 
and  negligence  are  united.” 

A  correspondent  of  The  Gentleman’s  Magazine, 
5  December  1805. 

The  Army  epidemiologist  is  blessed  with  a  work  en¬ 
vironment  wherein  two  institutionalized,  independently- 
operated  data  systems  record  the  same  phenomenon — 
occurrence  of  death.  This  happenstance  provides  the  rare 
opportunity  to  ascertain  the  reliability  of  mortality  report¬ 
ing  and  thus  study  the  integrity  of  one  of  epidemiology’s 
most  basic  and  trusted  vital  statistics. 

Both  the  Office  of  the  US  Army  Surgeon  General 
(OTSG)  and  the  Office  of  the  US  Army  Adjutant  General 
(OTAG)  operate  and  maintain  electronic  data  processing 
systems,  which  include  as  input  the  personal  identifiers  and 
related  information  on  all  deaths  of  the  Army  active  duty 
soldiers.  These  two  data  systems  are  separate  and  distinct 
from  each  other,  arising  from  differing  sets  of  requirements 
and  performing  different  missions.  Input  data  are  collected 
by  different  individuals,  using  different  documents.  The 
workers  who  operate  the  systems  are  organizationally  and 
spatially  located  in  two  separate  Army  agencies. 

The  medical  data  base  was  begun  electronically  in  1971 
and  is  described  in  Army  Regulation  40-400. 1  It  is  referred 
to  as  the  Individual  Patient  Data  System  (IPDS),  Casualty 
accounting  is  mandated  by  OTAG’s  Organization  and 
Functions  Manual2  and  is  accomplished  by  what  is  known 
as  the  Casualty  Information  System  (CIS).  Its  master  file 
contains  all  Army  casualties  from  1961  forward. 

The  purpose  of  this  paper  is  to  describe  the  extent  of 
correspondence  found  in  death  occurrences  extant  in  these 
two  independent  reporting  systems,  covering  the  same  pop¬ 
ulation  for  the  same  period  of  time.  A  subsidiary  purpose  is 
to  describe  similarly  the  agreement  on  suicide  as  a  cause  of 
death  in  the  identical  population. 

Method 

A  magnetic  tape  containing  the  IPDS  r‘->  on  each  Army 
active  duty  member  who  died  during  the  period  from  1 
January  1975  through  31  December  1976  was  requested 
and  received  from  the  Patient  Administration  Office  of 
OTSG.  A  computer  printout  of  a  portion  of  the  master  file 
of  CIS,  listing  the  Army  active  duty  individuals  who  died 
during  the  same  period,  was  requested  and  received  from 
the  Casualty  Services  Division  of  OTAG. 

Data  on  the  IPDS  tape  were  processed  by  using  equip¬ 
ment  at  The  Computer  Center,  Division  of  Computer  Re- 

From  the  Division  of  Neuropsychiatry,  Walter  Reed  Army  Institute  of 
Research,  Washington,  D.C.  20012. 

•Research  Psychologist. 


search  and  Technology,  National  Institutes  of  Health,  Be- 
thesda,  Maryland.  Processing  the  tape  resulted  in  a 
computer  printout,  which  listed  the  contents  of  the  IPDS 
file  for  all  those  Army  active  duty  persons  who  died  during 
the  two-year  period  studied. 

To  accomplish  the  task  of  tabulating  those  individuals 
common  to  either  death  list  and  those  individuals  unique  to 
either  death  list,  the  two  computer  printouts,  each  ordered 
sequentially  by  Social  Security  Administration  number 
(SSAN),  were  inspected  by  hand. 

The  only  personal  identifier  common  to  both  IPDS  and 
CIS  is  the  SSAN.  (CIS  contains  the  individual’s  name,  but 
IPDS  does  not.)  Consequently,  SSAN  identity  was  used  as 
the  first  criterion  in  establishing  coexistence  on  either  list. 
When  SSANs  were  very  similar  but  not  identical,  the  date 
of  death,  grade,  and  age  date  were  consulted  to  decide  the 
question  of  identity. 

IPDS  deaths  were  attributed  to  suicide  when  a  code  of 
“4”  ( =  intentionally  self-inflicted  injury)  had  been  assigned 
to  the  variable  Type  Case:  Injury  Category.  CIS  deaths  were 
tallied  as  suicides  when  a  code  of  “B”  (=  intentionally 
self-inflicted  injury)  appeared  under  the  variable  Major  At¬ 
tributing  Cause. 

A  third  list  of  soldier  suicides  for  the  same  two-year 
period  was  also  available  for  comparison.  Datel  and  John¬ 
son3  reported  on  what  they  believed  to  have  been  all  Army 
active  duty  suicides  during  calendar  years  1975  and  1976. 
Their  suicide  cases  accumulated  as  a  result  of  OTAG’s 
administrative  policy  that  all  cases  labeled  suicide  by  the 
line  of  duty  investigatory  procedures  be  reviewed  by  the 
Psychiatry  Consultant  in  OTSG,  for  an  official  opinion  on 
the  deceased’s  mental  competence.  This  third  list  of  suicides 
is  referred  to  herein  as  the  D  and  J  list. 

TABLE  1 

NU®ER  OP  SOLDIERS  REPORIED  AS  HAVING  DIED  DURIN0  CALENDAR  YEARS  1975/1976  BY  WE 
INDIVIDUAL  PATIENT  DATA  SYSTEM  (IPD6)  AND  BY  WE  CASUALTY  INFORMATION  SYSTEM  (CIS) 


Death  reported  by  IPE6 


Yes 

No 

Ttotal 

Yes: 

*1561  (63-5*) 

617  (25.1*) 

2178 

Death  reported  by  CIS 

No- 

267  (10.9*) 

13*  (0.5*) 

260 

Total: 

1828 

630 

2958 

*These  are  the  13  deaths  appearing  on  the  D&J  list^  and  not  found  cn  either  IPES  or 
CIS  death  lists.  It  is  unknown  hew  many  additional  deaths  occupy  the  No/No  cell. 
When  the  raetnod  presented  by  Chandrasekar  and  Deming1*  Is  used  to  estimate  the  size 
of  the  No/No  cell  frera  the  infonration  contained  in  the  other  three  cells,  the 
result  is  106.  If  the  13  cases  are  replaced  with  toe  estimated  106  cases,  the 
total  number  of  deaths  Tor  1975/1976  Junps  frera  2458  to  2551 . 
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TABI£  2 


VARIATIONS  IN  TOE  ANNUAL  UNTIED  STATES  SOLDIER  MORTALITY  RATE  TOR  IKE 
SAJE  WORLDWIDE  POPULATION  TOR  THE  SAME  TWO-YEAR  PERIOD 


Source  of  Death  Count 

Nunber  of  Deaths 

Annual  Mortality  Rate 

Der  100.000* 

IPDS  (COSO) 

1828 

116.9 

CIS  (OTAG) 

2178 

139-3 

IPDS  and  CIS 

irt 

•=r 

-=r 

cvj 

156.il 

IPDS,  CIS  and  D&J 

2458 

157.2 

IPDS,  CIS  and  estimate 

2551 

163.1 

*Based  on  the  two-year  strength  figure  of  1,563,750.  ^ 


Findings 

Mortality  Enumeration 

The  IPDS  file  contained  1,836  soldier  deaths  for  the 
years  1975  and  1976  combined.  Duplicate  or  near-duplicate 
records  were  present  for  eight  persons.  After  these  duplicates 
were  deleted,  the  resultant  death  count  from  the  Army 
medical  data  base,  therefore,  was  1,828. 

The  CIS  death  listing  contained  2,237  entries  for  the 
two-year  period.  However,  59  entries  were  duplications,  so 
the  net  death  count  according  to  TAGO’s  accounting  system 
was  actually  2,178. 

Common  to  both  death  lists  was  a  total  of  1,561  persons. 
Appearing  on  one  list  only  was  a  total  of  884  persons,  267  of 
whom  were  unique  to  the  IPDS  list  and  617  of  whom  were 
present  only  on  the  CIS  list.**  Thirteen  additional  deaths 
appeared  on  the  D  and  J  suicide  list  and  were  not  found  in 
either  IPDS  nor  CIS.  Unknown  is  how  many  deaths  beyond 
the  enumerated  total  of  2,458  occurred  in  the  Army  during 
1975  or  1976  and  were  recorded  on  none  of  the  three  lists. 
These  mortality  counts  are  arrayed  in  Table  1  and  the 
percentages  of  the  total  deaths  reported  are  presented  for 
each  cell  in  the  matrix. 

The  variation  in  soldier  mortality  rate  produced  by  these 
inconsistencies  in  death  count  can  be  seen  in  Table  2.  The 
combined  1975-1976  mid-year  active  duty  Army  strength 
was  obtained  from  DOD  OASD  (Comptroller).5 

Suicid*  Enumeration 

Datel  and  Johnson3  reported  255  cases  of  Army  active 
duty  suicide  for  the  years  1975-1976.  IPDS  was  found 
to  contain  132  deaths  labeled  as  due  to  intentionally  self- 
inflicted  wounds,  and  CIS  contained  1 72  such  deaths  for  the 
same  two-year  period.  These  three  lists  produced  a  total  of 


**In  performing  the  manual  search  for  commonality  and  uniqueness 
between  the  two  death  lists,  there  occurred  69  cases  in  which  the  SSANs 
did  not  match  each  other  exactly,  but  which  were  classified  as  identities 
because  of  sufficient  correspondence  between  date  of  death,  age.  and  grade 
data.  It  is  important  to  note  that,  had  the  SSAN  been  used  as  the  sole 
criterion  for  agreement,  these  69  cases  (9.8  per  cent)  would  have  been 
misclassified  as  “uniques”  and  the  total  death  count  would  have  risen 
accordingly. 


.302  individuals  whose  death  was  reported  as  suicide  by. one 
or  more  of  the  three  tabulators.  Tables  3  and  4  enumerate 
and  array  the  suicide  counts  from  the  three  lists,  in  such  a 
manner  as  to  illustrate  the  extent  to  which  a  case  labeled  as 
sucide  on  one  list  appeared  also  as  a  suicide  cn  one  or  both 
of  the  other  lists.  , 

The  question  may  also  be  asked,  “Given  the  appearance 
of  suicidal  death  on  one  of  the  lists,  to  what  extent  did  the 
deceased  appear  as  a  death  at  all  (i.e.,  due  to  any  cause 
whatsoever)  on  the  other  death  lists?”  Table  5  answers  this 
question  by  presenting  the  number  and  per  cent  of  the 
sucides  appearing  on  one  list  who  also  appear,  first,  as  a 
suicide  on  IPDS  and  on  CIS  and,  second,  as  a  death  at  all 
on  IPDS  and  on  CIS. 

These  reliability  data  can  be  further  elaborated  by  not¬ 
ing  that,  of  'he  302  soldiers  whose  death  was  labeled  as 
suicide  by  one  or  more  of  the  three  tabulators,  only  236 
(78.1  per  cent)  appeared  as  a  death  at  all  on  the  IPDS  list 
and  only  248  (82.1  per  cent)  were  found  as  a  death  due  to 
any  cause  whatsoever  on  the  CIS  list. 

The  varying  suicide  counts  produce  a  greater  than  two  to 
one  difference  in  the  range  of  resultant  annual  suicide  rates 
(Table  6). 

Discussion 

How  many  American  soldiers  died  during  the  years  1975 
and  1976?  The  Adjutant  General  reported  2,178  deaths, 
some  16  per  cent  more  than  the  Surgeon  General  count  of 
1,828.  Together,  both  systems  reported  2,445,  a  gain  of  11 
per  cent  over  the  highti  single-system  count.  Thirteen  more 
deaths,  not  recorded  in  either  CIS  or  IPDS,  were  also  dis¬ 
covered. 

There  was  only  63.5  per  cent  commonality  in  the  mortal¬ 
ity  lists  of  the  two  independent  electronic  data  processing 
systems  studied.  The  casualty  reporting  system  contained  89 
per  cent  of  the  2,458  total  (?)  deaths,  and  the  medical  data 
base  contained  only  74  per  cent  of  the  total  number  of 
deaths.  There  results  are  judged  to  represent  an  unsatisfac¬ 
tory  degree  of  reliability  for  scientific  purposes.  Presumably, 
they  are  also  unsat'sfactory  for  administrative,  planning,  or 
legal  use  of  the  information,  as  well. 

In  response  to  these  findings,  two  principal  questions 
arise:  What  are  the  reasons  for  the  discrepancy  in  death 
count?  What  are  the  implications  of  such  results? 

TABI£  3 

THE  DISTKLBOTICN  BY  WHICH  302  SOLDIER  DEATHS,  LABELED  AS  SUICIDE  BY  ONE  OR 

HMS  OP  THEBE  LISTS,  APPEARED  AIDO  AS  A  SUICIDE  CN  G.,lERS  OP  THE  THffiE  LISTS 


Appeared  as  a  suicidal  death  <xi:  farter  Per  cent 


Cne  list  only 

Uniquely  DU :  70 
Uniquely  IPES:  26 
Uniquely  CIS.  17 

113 

37.4 

IWo  lists  cnly 

Uniquely  D4J/IPES: 
Uniquely  D&J/CIS: 
Ihiqueiy  IPD6/CIS. 

3K 

83 

t 

121 

40.1 

All  three  lists 

68 

22.5 

Ibtal 

302 

100.0 
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TABUS  4 

SUICIEE  LABELING  OOWDNALITI  BETWEEN  PAIR  COMBINATIONS  OP  THREE  LISTS* 


D&J 

IPES 

CIS 

DSJ: 

255  (84. W 

102  <33.8*) 

151  (50.0*) 

IPDS  I 

132  (113.7*) 

72  (23.8*) 

CIS: 

172  (57.0*) 

‘percentages  based  cn  N  *  302  *  r.xfcer  of  soldier  deaths  labeled  as 
suicide  by  one  or  more  of  the  three  lists. 


Reasons  for  Unsatisfactory  Reliability 

One  can  rationalize  several  possibilities,  or  their  combi¬ 
nation,  to  account  for  the  inconsistency  in  death  tallies 
between  IPDS  and  CIS:  (a)  There  was  outright  fraudulent 
reporting  of  death  into  one  system,  but  not  into  the  other 
(invalid  reporting);  (b)  there  was  mistaken  reporting  of 
death  into  one  system,  but  not  into  the  other  (invalid  re¬ 
porting);  (c)  personal  identifiers  attached  to  the  deceased 
differed  from  one  system  to  the  other  (misidentification 
reporting);  (d)  individuals  were  categorized  incorrectly  by 
one  of  the  systems  (misclassification  reporting);  and  (e) 
deaths  were  recorded  validly  and  accurately  in  one  system 
but  were  not  recorded  at  all  in  the  other  (incomplete  report¬ 
ing)- 

If  the  error  were  of  the  (a)  or  (b)  variety,  the  person  who 
was  called  dead  was  actually  alive.  If  the  error  were  (c),  the 
person  called  dead  was  indeed  dead,  was  accounted  for  in 
either  system,  but  was  misidentified  in  at  least  one  of  the 
two  systems.  If  the  error  were  (d),  the  person  called  dead  was 
indeed  dead,  but  his  military  status  was  incorrectly  recoded 
in  one  of  the  two  systems.  If  the  error  were  (e),  the  person 
called  dead  was  indeed  dead,  but  one  of  the  two  systems 
contained  no  record  of  the  death. 

Misidentificaticn  reporting  was  observed  to  have  been 
operative  in  the  69  instances  wherein  social  security  num¬ 
bers  did  not  agree,  but  other  identifying  information  did 
agree.  Other  instances  of  mistaken  disagreement  in  social 
security  numbers  may  have  gone  undetected.  Matching 
cases  which  contain  errors  in  personal  identifiers  is  a  techni¬ 
cal  problem,  made  unnecessarily  difficult  in  this  instance  by 
the  failure  of  IPDS  to  include  the  individual’s  name  as  a 
data  element  in  the  system.  Studies  such  as  the  one  at  hand 
reveal  the  flawed  wisdom  in  withholding  names  from  the 
files  of  person-based  data,  when  designing  a  g  meral  purpose 
medical  information  system. 

Misclassification  reporting  is  also  known  t<  have  contrib¬ 
uted  to  the  imperfect  correspondence  betv,  ecn  the  two  death 
lists.  It  was  observed  that  some  soldiers  suffering  from  a 
terminal  illness  were  medically  retired  from  the  Service  just 
prior  to  their  expectant  deaths,  but  their  IPDS  files  indi¬ 
cated  that  they  died  while  on  active  duty.  Such  instances 
represent  an  unknown  proportion  of  the  267  individuals 
recorded  as  deaths  in  IPDo,  but  not  found  as  active  duty 
deaths  in  CIS. 

It  seems  quite  probable  that  a  goodly  portion  of  the 
discrepancy  between  the  two  death  lists  was  due  to  incom¬ 
plete  reporting — by  either  system.  This  finding,  although 


circumscribed  as  it  is  here  to  the  military,  raises  the  question 
of  death  count  coverage  in  general. 

The  completeness  of  death  reporting  within  the  United 
States  as  a  whole  has  not  been  well-studied.  It  is  known, 
however,  that  some  deaths  each  year  go  officially  unnoticed. 
Some  fetal  and  infant  deaths  and  some  cases  of  homicide 
are  never  registered.  Also,  there  have  apparently  been  in¬ 
stances  in  which  states  have  reported  some  deaths  too  late 
for  them  to  get  entered  into  the  official  count  tallied  annu¬ 
ally  by  the  Nation  Center  for  Health  Statistics.  While  this 
proportion  of  unregistered  or  unreported  deaths  in  the 
United  States  is  assumed  to  be  small,  it  is  unknown.6 

When  the  reliability  of  death  tabulation  has  been  for¬ 
mally  studied  in  other  countries,  the  results  have  been  sur¬ 
prisingly  similar  to  what  I  report  here — at  least  in  two 
instances,  Glass7  compared  two  separate  death  registries, 
each  compiled  for  London  for  the  years  1696  to  1699,  parish 
registration  entries  versus  special  tax  collector  records.  He 
found  that,  out  of  a  total  of  3,922  deaths,  61 1  were  unique 
to  the  tax  collector  records  and  1,058  .vere  unique  to  the 
parish  registries.  This  represents  only  57.4  per  cent  com¬ 
monality,  Thomlinson8  studied  a  dual  record  system  for  the 
recording  of  deaths  in  Morocco  in  1972.  Out  of  a  total  of  75 
deaths,  only  39  persons  could  be  successfully  matched  from 
the  two  death  lists.  This  is  52.0  per  cent  commonality. 
Razzell9  offers  a  number  of  reasons  for  what  he  observes  to 
have  been  large-scale  under-registration  of  deaths  in  19th- 
century  England.  Computer  technology  notwithstanding, 
the  present-day  picture  may  not  be  significantly  better. 

A  death  event  will  go  unreported  as  such  for  official  and 
historical  purposes  if  it:  (a)  goes  unregistered;  (b)  is  regis¬ 
tered  but  is  not  forwarded:  or  (c)  is  registered  and  forwarded 
but  is  not  recorded  statistically.  From  the  point  at  which  a 
person  is  observed  to  have  expired  to  the  point  that  the 
deceased  is  represented  as  an  increment  of  one  in  the  vital 
statistics  archives,  a  rather  complex,  interdependent  chain 
of  events  must  properly  unfold.  In  the  study  being  reported 
here,  something  obviously  went  askew  in  this  chain  of 
events.  To  what  extent  such  a  chain  of  events  is  broken  in 
other  contemporary  settings  in  unknown. 

It  is  not  the  purpose  of  this  paper  to  diagnose  the  system 
deficiencies  which  created  the  results  obtained.  However, 
such  a  painstaking  endeavor  needs  to  be  the  next  step,  not 
only  for  system  integrity  but  for  understanding  the  human 
engineering  issues  behind  the  inconsistencies  detected.  For 
example,  it  would  appear  that  the  trouble-shooting  process 
will  need  to  concern  itself  with  the  question,  “What  conse¬ 
quences  are  attached  to  the  reporter  for  reporting  and  for 
not  reporting  deaths?”  Given  the  data  obtained  here,  it 
becomes  no  longer  possible  to  assume  that  issuance  of  a 
directive  is  tantamount  to  performance  of  the  behavior 
directed,  or  that  a  cooperative  agreement  results  in  the 
behavior  agreed  upon. 

Implications  of  Unatisfactory  Reliability 

Some  of  the  implications  of  an  unreliable  death  record 
system  are  painfully  obvious  and  need  not  be  delineated. 
For  the  epidemiologist,  the  most  destructive  implication  is 
the  one  of  suspicion.  If  mortality  cannot  be  counted  reliably, 
how  then  must  go  morbidity?  As  regards  death,  we  have 
quite  hard  criteria  for  case  definition:  case  finding  in  mor- 
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TABLE  5 

TOE  EMBtT  TO  HHICH  DECEASED  SOLDIERS  LABELED  AS  IEATO  B 1  SUICUE  BY  ONE  REPORT®*! 
SYSIBI  AfE  SO  LABELED  BY  ANOTHER  REPORTING  SYSTEM,  AND  TOE  EXIENT  TO  VMCH  SUCH 
SUICIDES  APE  CAPTOPED  AS  A  DEATH  AT  ALL  BY  TOE  OTHER  JEPOKTDM  SYSIEM(S) 


IJunfcer  cf  Suicides  on  List 

Appear  on  IPES 

as 

-julolje  De&ttj 

Appear  on  CIS 
as 

.  Suicide  Death 

>  ' 

i  i 

DAvJ:  255 

102  40.0 

195  76.5 

151  59.2 

214  83.9 

IPES:  132 

132  100.0 

132  100.0 

72  54.5 

102  77-3 

CIS:  172 

72  41.9 

129  75.0 

172  100. 0 

172  100.0 

bidity  is  much  more  influenced  by  observer  differences,  How 
reliable  are  our  counts  of  mental  illness?  Of  hypertension? 
Of  battle  wounds? 

Attribution  of  suicide  is  a  cause  of  death  question — not 
unlike  matters  of  differential  diagnosis.  To  ask  how  reliable 
was  the  obtained  count  on  suicide,  then,  is  to  inquire  into 
data  reliability  on  a  matter  akin  to  that  involved  in  the 
study  of  morbidity.  The  results  give  little  cause  for  rejoicing. 

Of  302  persons  labeled  suicide  by  at  least  one  of  the  three 
record  systems,  unanimous  agreement  on  suicide  as  the 
cause  of  death  occurred  for  only  22.5  per  cent  of  the  cases. 
In  40  per  cent  more  instances,  two  of  the  three  lists  agreed 
with  each  other.  Thirty-seven  per  -ent  of  the  time,  the 
person  appeared  as  a  suicide  on  only  me  of  the  three  lists. 

ConsidcrinylPDS  and  CIS  only,  a  total  of  23*'  persons 
were  labeled  as  suicides  by  one  or  both  of  the  two  systems. 
Of  this  number,  only  72  (or  31  per  cent)  were  mutually 
labeled  as  suicide  by  the  two  systems. 

Even  more  discouraging  was  the  finding  that,  of  the  132 
persons  labeled  suicides  by  IPDS,  only  77  per  cent  could  be 
found  in  CIS  as  having  died  at  all;  and,  of  the  1 72  persons 
labeled  suicides  by  CIS,  only  75  per  cent  could  be  found  in 
IPDS  as  having  died  at  all. 

Finally,  the  question  arises  as  to  whether  the  death  omis¬ 
sions  from  IPDS  and  from  CIS  were  systematic  or  random. 
If  the  death  omissions  were  systematic,  say  with  respect  to 
age,  grade,  rate.,  or  cause  of  death,  the  dpta  would  produce 
not  only  a  depressed  mortality  rate  but  an  unrepresentative 
picture  of  the  demography iof  the  mortality.  Such  informa¬ 
tion  accumulated  over  time  could  be  quite  misleading  to 
medical  investigators  and  planners. 

The  conclusion  is  reached  that  the  level  of  agreement  in  a 

TABUS  6 

'ARIATTONS  IN  THE  ANNUAL  UNITED  STATES  SOLDIER  SUICIDE  RATE  FOR  THE 
SAKE  WORLDWIDE  POPULATION  FOR  THE  SAME  TWO-YEAR  PERIOD 


Annual  Suicide  Rate 


Source  of  Suicide  Count 

hunter  of  Suicides 

Der  100,000 

IPDS 

132 

8.4 

CIS 

172 

11.0 

D&J 

255 

16.3 

IPDS,  CIS  AND  D&J 

302 

19-3 

«  c 

Based  on  the  two-year  strength  figure  of  1,563,750. 


two-year  soldier  mortality  count  between  two  parallel  elec¬ 
tronic  data  processing  systems  in  the  US  Army  is  unaccept¬ 
able  for  epidemiologic  purposes.  The  low  level  of  agreement 
is  most  probably  due  to  incomplete  reporting  by  either 
system.  It  is  further  concluded  that,  when  epidemiologic 
counts  are  made  on  heahh  events  other  than  simple  death 
tabulations,  for  example  on  cause  of  death  due  to  suicide, 
the  reliability  between  the  systems  compared  drops  even 
lower. 

The  results  of  the  study  imply  that  a  scientific  require¬ 
ment  exists  to  conduct  periodic  reliability  checks  on  epide¬ 
miologic  data  inserted  into  and  contained  within  modem 
electronic  data  processing  systems.  When  reliability  reaches 
unsatisfactory  levels,  as  in  the  present  study,  responsible 
agencies  are  thereby  alerted  and  system  examination,  re¬ 
pair,  and,  if  necessary,  redesign  are  instigated. 

Summary 

The  extent  of  agreement  in  soldier  death  count  between 
two  independent  electronic  information  systems  in  the  US 
Army,  one  medically-based  and  the  other  personnel-based, 
was  studied  for  calendar  years  1975  and  1976  and  was 
found  to  be  unsatisfactory  for  epidemiologic  purposes.  The 
two  death  lists  shared  only  63.5  per  cent  commonality  in  the 
total  mortality  count  of  2,458  cases.  Agreement  in  suicide 
labeling  was  also  studied  and  found  to  be  even  lower. 

Possible  reasons  for  the  discrepancies  are  discussed,  and 
implications  of  such  low  reliability  for  military  epidemiol¬ 
ogy  are  drawn.  It  is  unknown  whether  the  low  reliability 
found  in  the  military  setting  is  also  a  significant  problem  in 
the  United  States  in  general,  but  it  was  learned  that  death 
enumeration  is  not  a  new  problem  to  the  English-speaking 
world. 
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